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Introductory Comments 
Pursuant to 37 C.F.R. § 41.37, Appellant hereby submits an Appeal Brief 
for Application Serial No. 10/733,876 filed Dec 10, 2003. A Notice of Appeal was 
filed on March 20, 2006. Concurrently with the Notice of Appeal, Appellant filed 
a Pre- Appeal Brief Request. The Office responded to the Request on May 17, 
2006. Therefore, the due date for submitting an Appeal Brief was set for June 17, 
2006. Appellant appeals to the Board of Patent Appeals and Interferences 
(hereinafter "Board") seeking review of the Office's rejections. 
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(i) Real Party in Interest 

The real party in interest is the Microsoft Corporation, the assignee of all 
right and title to the subject invention. 



fii) Related Appeals and Interferences 

Appellant is not aware of any other appeals or interferences which will 
directly affect, be directly affected by, or otherwise have a bearing on the Board's 
decision to this pending Appeal. 

fiifl Status of Claims 

Allowed Claims : No claims have been allowed. 

Canceled Claims : Claims 2, 3, 20, and 27 were previously canceled. 

Originally Presented Claims : Claims 1-34 were originally presented 
when this Application was filed. 

Pending Claims : Claims 1, 4-19, 21-26 and 28-34 stand rejected and are 
pending in this Application as set forth in the Claims Appendix on page 15. 

Appealed Claims : All of the pending claims are subject to this Appeal. 
Claims 1, 4-19, 21-26 and 28-34 stand rejected under 35 U.S.C. § 102(b) as being 
anticipated by U.S. Patent No. 5,412,428 to Taliara. Claim 29 was rejected under 
35 U.S.C. § 103(a) as being unpatentable over the Tahara reference in view of 
Official Notice These rejections are set forth in the Final Office Action dated 
October 18, 2005. 
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fiv> Status of Amendments 

A Final Office Action was issued on October 18, 2005 whereupon 
Appellant filed a Response on January 6, 2006 to address the rejections of pending 
claims. No claims were amended or canceled in the Response. 

An Advisory Action was issued on February 17, 2006 in response to the 
Response filed on January 6, 2006. The Advisory Action stated that the fled 
Response would be entered for the purposes of appeal. 

(y) Summary of Claimed Subject Matter 

The following is a concise explanation of each independent claim 1, 11, 19, 
26 and 30 involved in the Appeal and includes references to the specification by 
page and line number, and to the drawings. The independent claims are not to be 
limited solely to the elements identified by the reference characters. 

Claim 1 recites receiving a video information stream including color 
information formatted according to a first color space sampling format having a 
pre-determined number of bits (page 22, lines 6-7 and figure 11), splitting the 
color information into a base information stream formatted according to a second 
color space sampling format having less than the pre-determined number of bits 
and into an enhanced information stream, wherein the enhanced information 
stream is selectively encoded using spatial information obtained from processing 
of the base information stream or using a previous reference obtained during 
processing of the enhanced information stream (page 23, lines 3-18 and figure 11), 
and providing an indicator with at least one of the base information stream and the 
enhanced information stream that indicates a capability for providing video 
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information according to the first color space sampling format or the second color 
space sampling format (page 25, lines 1-25 and figure 11). 

Claim 11 recites converting a first multimedia format into a base stream 
and an enhanced stream, the base stream corresponding to another multimedia 
format and the enhanced stream including information that when combined with 
the base stream re-constructs the first multimedia format, wherein the enhanced 
stream is selectively encoded using spatial information obtained from processing 
of the base stream or using a previous reference obtained during processing of the 
enhanced stream (page 23, lines 3-18 and figure 11; and page 25, lines 1-25 and 
figure 11). 

Claim 19 recites a base encoder for encoding a base information stream 
formatted according to a first color space sampling format (page 23, lines 3-18 
and figure 11), and an enhanced encoder for encoding an enhanced information 
stream that contains color space information unavailable in the first color space 
sampling format, wherein the enhanced encoder selectively encodes the enhanced 
information stream using spatial information obtained from processing of the base 
information stream or using a previous reference obtained during processing of the 
enhanced information stream (page 25, lines 1-25 and figure 11). 

Claim 26 recites a base decoder for decoding an encoded base bit stream 
associated with a first color space sampling format (page 23, lines 3-18 and figure 
11), and an enhanced decoder for decoding an encoded enhanced bit stream that 
contains color space information unavailable in the first color space sampling 
format wherein the enhanced decoder selectively decodes the enhanced 
information stream using spatial information obtained from processing of the base 
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information stream or using a previous reference obtained during processing of the 
enhanced information stream (page 25, lines 1-25 and figure 11). 

Claim 30 recites an input for receiving video information (page 22, lines 6- 
7 and figure 11), a circuit for formatting part of the video information according to 
a color space sampling format and formatting another part of the video 
information according to another format, wherein the other format is selectively 
encoded using spatial information obtained from processing of the part of the 
video information or using a previous reference obtained during processing of the 
other part (page 23, lines 3-18 and figure 11; and page 25, lines 1-25 and figure 
11), and a circuit for storing the part of the video information and the other part of 
the video information. 

(vi) Grounds of Rejection to be Reviewed on Appeal 

Claim Rejection Under 35 U.S.C. j 102 

Claims 1, 4-19, 21-26 and 28-34 stand rejected under 35 U.S.C. §102(b) as 
being anticipated by U.S. Patent No. 5,412,428 to Tahara (hereinafter referred to 
as the Tahara reference). 
Claim Rejection Under 35 U.S.C. $ 103 

Claim 29 was rejected under 35 U.S.C. § 103(a) as being unpatentable over 
the Tahara reference in view of Official Notice. 



LEE & HAYES, PLLC 
APPEAL BRIEF 



7 



ATTORNEY DOCKET NO. MS1-1 806US 
Serial No. 10/733,876 



(vii) Argument 



(A) Claims 1. 4-19. 21-26 and 28-34 are allowable because the 
Tahara does not disclose or suggest the subject matter of these 
claims 

In overview, in order for prior art to anticipate a claim under 35 U.S.C. 
§102 every element of the claimed invention must be identically disclosed either 
expressly or under principles of inherency in a single reference. Further, the 
exclusion of a claimed element from a prior art reference, no matter how 
insubstantial, is enough to negate anticipation by that reference. The test of 
whether anticipation exists in a particular case is a question of fact, and is applied 
element-by-element to a single prior art reference. Only if the prior art literally 
reads on every element of the rejected claim will the claimed invention be 
anticipated under this test. 

With this in mind, the Appellant analyzes the §102 rejection of the claims in 
the present application. Independent Claim 1 includes the subject matter: "wherein 
the enhanced information stream is selectively encoded using spatial information 
obtained from processing of the base information stream or using a previous 
reference obtained during processing of the enhanced information stream." 
Independent Claims 11, 19, and 30 include similar subject matter as well. 
Independent Claim 26 includes the subject matter: "wherein the enhanced decoder 
selectively decodes the enhanced information stream using spatial information 
obtained from processing of the base information stream or using a previous 
reference obtained during processing of the enhanced information stream." 
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The present Application describes a process of spatially predicting a P- 
frame (enhanced information) using a reference from a base stream that is stored 
in a frame buffer 1132. Also, the present Application describes a process of 
predicting a P-frame from a previous reference generated from the enhanced 
stream stored in a frame buffer 1152. A switch 1158 is capable of selectively 
choosing one of these processes. The Office is directed to page 25 of the present 
Application for further information related to the foregoing description. 
Selectively being able to choose between the two processes provides greater 
efficiency in prediction coding and results in a performance boost in comparison 
to traditional encoding mechanisms. 

On page 3 of the current Office Action, the Office asserts column 8, lines 
54-64 and column 23, lines 23-35 teach the indicated subject matter of the 
independent claims. Appellant disputes the Office's assertions for the following 
reasons. 

The Office asserts Tahara teaches an enhanced information stream that is 
selectively encoded using spatial information obtained from processing of a base 
information stream, or using a previous reference obtained during processing of 
the enhanced information stream. To substantiate this assertion, the Office 
maintains that a data stream of a circuit 101 is selectively encoded by way of a 
select circuit 176. According to the Office, the select circuit 176 selects a 
predictive error from a data stream of a circuit 100, or a predictive error from "a 
previous reference of 101." Regarding the quoted text, the Appellant is not 
entirely sure what the Office is tying to convey here. The Appellant assumes the 
Office is asserting that the select circuit 176 is capable of selecting a predictive 
error that is generated by a circuit 101. The Appellant requested that the Office 
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clarify the quoted text. Unfortunately, the Office did not do so. The preceding 
discussion is a summary of the Office's assertions found on page 3, second full 
paragraph, of the current Office Action. 

The Appellant will now describe how the instant claimed invention differs 
from the Tahara encoding and decoding methods. The circuit 101 is for 
processing color difference signals with intermediate definition, where the circuit 
100 is for processing color difference signals with the lowest definition and the 
luminance signals. (See column 22, lines 48-53.) The color difference signals and 
luminance signals are described in the patent at column 8, lines 5-18. According 
to the Tahara description at column 23, lines 23-35, the select circuit 176 chooses 
between predictive error signals produced from an up sampling circuit 1 1 1 and 
predictive error signals produced from a motion compensating circuit 175. The 
circuit 101 includes the up sampling circuit 111 and the compensating circuit 175. 
(See Fig. 19). 

The up sampling circuit 111 and the motion compensation circuit 175 
produce the mentioned predictive error signals from the color difference signals 
that have intermediate definition. This is described in the Tahara patent at column 
23, lines 1-5. The color difference signals with the lowest definition and the 
luminance signals are not used to produce the predictive error signals discussed in 
the foregoing. Tahara confirms this fact by stating that the operation of the circuit 
100 is not discussed in conjunction with the circuit 101. (See column 22, lines 63- 
65.) Recall, the circuit 100 processes the color difference signals with the lowest 
definition and the luminance signals. (See column 22, lines 51-53.) The Office 
asserts the signals processed by the circuit 100 are analogous with the base 
information stream referenced in the claims. 
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The above shows that the Office's reasoning for finding claims 1, 11, 19, 
26 and 30 unpatentable lacks merit. In particular, Tahara cannot teach the 
recitation "the enhanced information stream is selectively encoded using spatial 
information obtained from the processing the base information stream" (claims 1, 
11, 19, and 30), or the recitation "the enhanced decoder selectively decodes the 
enhanced information stream using spatial information obtained from processing 
of the base information stream" (claim 26), as predictive error signals produced 
from an up sampling circuit 111 and predictive error signals produced from a 
motion compensating circuit 175 are not produced by processing signals from the 
circuit 100; only signals from the circuit 101 are used to produce the predictive 
error signals generated by the circuits 1 1 1 and 175. 

Regarding the claim recitation that teaches encoding the enhanced 
information stream "using a previous reference obtained during processing of the 
enhanced information stream" (claims 1, 11, 19, and 30), and the recitation that 
teaches an enhanced decoder that selectively decodes "using a previous reference 
obtained during processing of the enhanced information stream" (claim 26), 
Appellant respectfully submits that the Tahara is deficient in connection with these 
limitations as well. Specifically, Tahara describes that the select circuit 176 
compares predictive error signals output from the up sampling circuit 111 to 
predictive error signals output from the motion compensation circuit 175. (See 
column 23, lines 24-28.) The smaller predictive error signals are chosen based on 
this comparison. (See column 23, lines 28-29.) The chosen smaller predictive 
error signals are used for encoding and decoding the color difference signals. This 
teaching cannot be construed as teaching encoding/decoding the enhanced 
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information stream "using a previous reference obtained during processing of the 
enhanced information stream." 

Each of the remaining rejected dependent claims, depends from either 
independent Claim 1, 11, 19, 26, or 30 and includes other limitations that are not 
taught or suggested by the Tahara reference. Therefore, for at least some of the 
above reasons, Appellant respectfully submits that the §102 rejection of claims 1, 
4-19, 21-26 and 28-34 is improper, and respectfully requests reconsideration and 
withdrawal of this rejection. 

(B) Claim 29 is allowable at least due to its dependence upon an 
allowable independent claim 

Claim 29 was rejected under 35 U.S. C. §103 (a) as being unpatentable over 
the Tahara reference in view of Official Notice. For at least some of the reasons 
that follow, Appellant respectfully disagrees that the subject matter of claim 29 is 
obvious over the Tahara reference in view of Official Notice. 

In overview, as stated in MPEP § 2143, to establish a prima facie case of 
obviousness, three basic criteria must be met. First, there must be some 
suggestion or motivation, either in the references themselves or in the knowledge 
generally available to one of ordinary skill in the art, to modify the reference or to 
combine reference teachings. Second, there must be a reasonable expectation of 
success. Finally, the prior art reference (or references when combined) must teach 
or suggest all the claim limitations. The teaching or suggestion to make the 
claimed combination and the reasonable expectation of success must both be 
found in the prior art, not in applicant's disclosure. In re Vaeck, 947 F.2d 488, 20 
USPQ2d 1438 (Fed. Cir. 1991). 
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Further, as stated in MPEP § 2143.01, obviousness can only be established 
by combining or modifying the teachings of the prior art to produce the claimed 
invention where there is some teaching, suggestion, or motivation to do so found 
either in the references themselves or in the knowledge generally available to one 
of ordinary skill in the art. In re Fine, 837 F.2d 1071, 5 USPQ2d 1596 (Fed. Cir. 
1988); In re Jones, 958 F.2d 347, 21 USPQ2d 1941 (Fed. Cir. 1992). The mere 
fact that references can be combined or modified does not render the resultant 
combination obvious unless the prior art also suggests the desirability of the 
combination. In re Mills, 916 F.2d 680, 16 USPQ2d 1430 (Fed. Cir. 1990). 

Therefore, "all words in a claim must be considered in judging the 
patentability of that claim against the prior art." In re Wilson, 424 F.2d 1382, 165 
USPQ 494, 496 (CCPA 1970). If an independent claim is nonobvious under 35 
U.S.C. 103, then any claim depending therefrom is nonobvious. In re Fine, 837 
F.2d 1071, 5 USPQ2d 1596 (Fed. Cir. 1988). 

Without repeating the arguments discussed above, the Appellant maintains 
that the Tahara reference does not teach or suggest a decoder that "selectively 
decodes the enhanced information stream using spatial information obtained from 
processing of the base information stream or using a previous reference obtained 
during processing of the enhanced information stream" as recited in claim 26. 
Claim 29 is dependent on claim 26 and is at least allowable as a result of this 
dependency. 
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Conclusion 

Claims 1, 4-19, 21-26 and 28-34 are in condition for allowance. Appellant 
respectfully requests reconsideration and prompt allowance of the subject 
application. 



Date: By: 



Respectfully Submitted, 



TimR. Wyckoff 
Lee & Hayes, pile 
Reg. No. 46,175 
(206)315-4001 ext. 110 
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1 . (Previously Amended) A method comprising: 

receiving a video information stream including color information formatted 
according to a first color space sampling format having a pre-determined number 
of bits; 

splitting the color information into a base information stream formatted 
according to a second color space sampling format having less than the pre- 
determined number of bits and into an enhanced information stream, wherein the 
enhanced information stream is selectively encoded using spatial information 
obtained from processing of the base information stream or using a previous 
reference obtained during processing of the enhanced information stream; and 

providing an indicator with at least one of the base information stream and 
the enhanced information stream that indicates a capability for providing video 
information according to the first color space sampling format or the second color 
space sampling format. 

2. (Canceled) 

3. (Canceled) 

4. (Original) The method of claim 1, further comprising encoding the 
base information stream into a base encoded bit stream, encoding the enhanced 
information stream into an enhanced encoded bit stream, and combining the base 
encoded bit stream and the enhanced encoded bit stream into an output bit stream. 



LEE & HAYES, PLLO 
APPEAL BRIEF 



15 



ATTORNEY DOCKET NO. MS1-1806US 
Serial No. 10/733,876 



5. (Original) The method of claim 4, wherein the output bit stream 
comprises an interleaved stream of the enhanced encoded bit stream and the base 
encoded bit stream. 

6. (Original) The method of claim 4, wherein the output bit stream 
comprises a concatenated stream of the enhanced encoded bit stream and the base 
encoded bit stream. 

7. (Original) The method of claim 6, wherein the enhanced encoded bit 
stream follows the base encoded bit stream. 

8. (Original) The method of claim 4, wherein the output bit stream 
comprises a first file for the enhanced encoded bit stream and a second file for the 
base encoded bit stream. 

9. (Original) The method of claim 1, wherein the color information 
includes chrominance blocks. 

10. (Original) The method of claim 1, wherein the first color space 
sampling format comprises a YUV422 format and the second color space 
sampling format comprises a YUV420 format. 
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11. (Previously Amended) A computer-readable medium having 
computer-executable instructions, the instructions comprising: 

converting a first multimedia format into a base stream and an enhanced 
stream, the base stream corresponding to another multimedia format and the 
enhanced stream including information that when combined with the base stream 
re-constructs the first multimedia format, wherein the enhanced stream is 
selectively encoded using spatial information obtained from processing of the base 
stream or using a previous reference obtained during processing of the enhanced 
stream. 

12. (Original) The computer-readable medium of claim 11, wherein the 
multimedia format comprises an encoded video format. 

13. (Original) The computer-readable medium of claim 11, wherein 
converting the first multimedia format into the base stream and the enhanced 
stream comprises storing chrominance blocks associated with the other 
multimedia format in the base stream and storing the chrominance blocks that are 
not associated with the other multimedia format in the enhanced stream. 

14. (Original) The method of claim 1 1, further comprising encoding the 
base stream into a base encoded bit stream, encoding the enhanced stream into an 
enhanced encoded bit stream, and combining the base encoded bit stream and the 
enhanced encoded bit stream into an output bit stream. 
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15. (Original) The method of claim 14, wherein the output bit stream 
comprises an interleaved stream of the enhanced encoded bit stream and the base 
encoded bit stream. 

16. (Original) The method of claim 14, wherein the output bit stream 
comprises a concatenated stream of the enhanced encoded bit stream and the base 
encoded bit stream. 

17. (Original) The method of claim 16, wherein the enhanced encoded 
bit stream follows the base encoded bit stream. 

18. (Original) The method of claim 14, wherein the output bit stream 
comprises a first file for the enhanced encoded bit stream and a second file for the 
base encoded bit stream. 

1 9 . (Previously Amended) A device comprising: 

a base encoder for encoding a base information stream formatted according to a 
first color space sampling format; and 

an enhanced encoder for encoding an enhanced information stream that 
contains color space information unavailable in the first color space sampling 
format, wherein the enhanced encoder selectively encodes the enhanced 
information stream using spatial information obtained from processing of the base 
information stream or using a previous reference obtained during processing of the 
enhanced information stream. 

20. (Canceled) 

18 ATTORNEY DOCKET NO. MS1-1806US 

Serial No. 10/733,876 



lee & Hayes, pllc 



21. (Original) The device of claim 19, further comprising an output 
stream formulator that combines the encoded enhanced information stream and the 
encoded base information stream into an output stream. 

22. (Original) The device of claim 21, wherein the output stream 
comprises the encoded enhanced information stream interleaved with the encoded 
base information stream. 

23. (Original) The device of claim 21, wherein the output stream 
comprises the encoded enhanced information stream concatenated to the encoded 
base information stream. 

24. (Original) The device of claim 21, wherein the output stream 
comprises a first file containing the encoded enhanced information stream and a 
second file containing the encoded base information stream. 

25. (Original) The device of claim 24, wherein device comprises a 
digital video camera. 

26. (Previously Amended) A device comprising: 

a base decoder for decoding an encoded base bit stream associated with a 
first color space sampling format; and 

an enhanced decoder for decoding an encoded enhanced bit stream that 
contains color space information unavailable in the first color space sampling 
format wherein the enhanced decoder selectively decodes the enhanced 
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information stream using spatial information obtained from processing of the base 
information stream or using a previous reference obtained during processing of the 
enhanced information stream. 

27. (Canceled) 

28. (Original) The device of claim 26, further comprising a compositor 
for generating a second color space sampling format from the encoded enhanced 
bit stream and the encoded base bit stream. 

29. (Original) The device of claim 26, wherein the device comprises a 
set-top box. 

30. (Previously Amended) A device comprising: 
an input for receiving video information; 

a circuit for formatting part of the video information according to a color 
space sampling format and formatting another part of the video information 
according to another format, wherein the other format is selectively encoded using 
spatial information obtained from processing of the part of the video information 
or using a previous reference obtained during processing of the other part; and 

a circuit for storing the part of the video information and the other part of 
the video information. 

31. (Original) The device of claim 30, wherein the circuit for formatting 
comprises a programmable circuit. 
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32. (Original) The device of claim 30, wherein the circuit for storing 
comprises a programmable circuit. 

33. (Original) The device of claim 30, wherein the input comprises a 

sensor. 

34. (Original) The device of claim 30, wherein the input comprises at 
least one CCD array. 
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(ix) Evidence Appendix 

None. 
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(x) Related Proceedings Appendix 

None. 
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